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(5*0 A system for disseminating information ow a wide 
area network includes a central caching unit for storing 
data to be made available over the wide area network. 
Local access give users access to the wide area network 
Distributed caching units associated with the local access 
nodes for store cachcable material. A satellite 
conununkations system establishes satellite 
communications between the central caching unit and 
the local caching units for the transfer of cachcable 
material from the central caching unit to the local units 
A router at the local access nodes routes packets from 
users to a destination address. The router includes local 
routing tables containing the addresses of material 
cached at die associated local node and responds to 
routing requests for locally cached material by directing 
the requests to the local cache 
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ABSTRACT OF THE DISCLOSURE 

A system for disseminating information over a wide area network includes a 
centra] caching unit for storing data to be made available over the wide area network. 
Local access give users access to the wide area network. Distributed caching units 
associated with tbe local access nodes for store cachcable material A satellite 
communications system establishes satellite communications between the central caching 
unit and the local caching units for the transfer of cacheabtc material from the central 
caching unit to tbe local units. A router at the local access nodes routes packets from users 
to a destination address. Tbe router includes local routing tables containing tbe addresses 
of material cached at the associated local node and responds to routing requests for locally 
cached material by directing tbe requests to tbe local cache. 
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A LOW COST SATELLITE CACHING SYSTEM 

This invention relates generally to the distribution of large amounts of data over a 
network, such as the Internet, and more particularly to a satellite based Internet caching 
system. 

In recent years the Internet has become widely used as a means of disseminating 
information to a targe number of people. Users, who may have access to the Internet via 
an Internet Service Provider (ISP) can access web pages residing on servers that may be 
located anywhere around the globe. As usage increases, so do the demands on bandwidth, 
leading to congestion in the network, which results in frustrating delays for the users. 

One solution to the problem of ever increasing bancMdtb requirements is to bring 
web content to locations close to users by means of a cache. 

All caching systems attempt to move content closer to the client Two principal 
types of caching systems, demand and mirrored caching, are currently being deployed 
throughout the Internet 

In demand caching, clients request web material though a shared intermediary 
known as a proxy server, usually located at the Internet Service Provider (ISP). If the 
material is located on the proxy server, the proxy server returns the material to the client 
If not, the proxy server retrieves the material from the remote server, returns it to the 
client and caches it for later access by other clients. The material cached at the proxy 
server can in turn be accessed by other subscribers so that there is no need for them to 
access it through the network. 

Demand caching is passive to the content provider, users determine what is cached 
by their access patterns. Demand caching also involves a chain of caches: the client's 
cache, local to a client's browser, the proxy cache and sometimes intermediate network 
cache points. As the cache becomes full, stale material is removed on a 1 east use basis or 
by use of time-to-live parameters. 

Demand caching suffers from several problems. As the content provider is a 
passive participant in the scheme, it is often unaware that its material is being copied and 
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stored - demand caching often violates copyright laws; as cached copies and originals are 
not synchronized, the copy returned to other users is sometimes not the content provider's 
most recent copy but the previously cached version; as well, demand caching hierarchies, 
along with making routing difficult and being complex to maintain and implement, make 
it difficult for content providers to control access to their sites, to get an accurate picture 
of how often their pages are bang accessed or to provide custom support to local 
databases. 

In mirrored caching the content provider has a more active role. Toe content 
provider manages, or selects an agent to manage, a distributed system of mirrored sites. 
The sites are placed strategically through the network and the content provider or bis 
agent pro-actively maintains synchronization amongst these sites by distributing material 
over the Internet. 

Though providing more control to the web page owner, mirrored caching has its 
problems. The mirroring of sites is complex to maintain; the system forces end users to 
explicitly choose one of the mirrored sites; and. lastly, the sites are often remote from an 
ISP's point of presence; hence clients can still suffer from network delays. 



An object of the invention is to alleviate the afore-mentioned problems in the prior 



art. 



According to the present invention there is provided a system for disseininating 
information over a wide area network, c<munising a central caching unit for storing data 
to be made available over said wide area network; a plurality of local access nodes for 
permitting users to access said wide area network; distributed caching units associated 
with said local access nodes for storing cacbeable material; a communications system for 
establishing satellite communications between said central caching unit and said local 
caching units for the transfer of cacbeable material from said central caching unit to said 
local units; and routing means at said local access nodes for routing packets fiom users to 
a destination address, said routing means including local rooting tables containing the 
addresses of material cached al the associated local node and responding to routing 
requests for locally cached material by directing said requests to the local cache. 
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The communications systems is typically satellite-based, but could also be a 
terrestrial-based broadcast or multicast system. 

The invention is particularly applicable to the Internet, but may also be appUed to 
other wide area networks, such as Intranets. 

The system in accordance with the invention allows Internet web content to be 
stored at the local Internet provider level The system, referred to as Managed Distributed 
Caching CMDO. permits the use ofdifferential referencing of web page content, software 
filters and acknowledged satellite or terrestrial multicast to provide a low cost, easy to 
manage and copyright transparent, push caching service for the Internet More 
specifically, an aspect of the invention relates to a scheme of combining differential 
referencing and static routing of web page content that provides content providers wUb a 
seamless and controllable caching system. 

This invention addresses the problems of control, synchrony, complexity and 
performance that plagued the prior art. 

To give complete control to the content provider, system allows the content 
provider to split web content into cacheable and non-cacbeable elements. The splimng >s 
completely under the control of the content provider. The non eacheable elements are 
stored at the content provider-, site or, for smaD content providers through a virtual 
hosting mechanism at a central site. The content provider can now control and monitor 
access to its site and where d%ect contact with the user is required, provide access to non 
cached databases (eg. cgi) and other custom features. Cached items, on the other hand, 
are transferred to the central cache site. 

To ensure that the cached copies are up-to-date and synchronized across a 
r^orl.ttecacheableitems. stored at me central^ she. are disputed, by satellite 
or terrestrial multicast, to caches at the subscribing ISPs. 

To ensure that routing between cached and uncached elements is as simple as 
possible and easy to maintain, proxyless routing, through the use of static routes, is 
typically used at rite ISP router. 
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The invention also provides a method of disseminating information over a wide 
area network, comprising the steps of storing cacheable material to be made available 
over said wide area network at a central caching unit; broadcasting said cacheab le 
material to distributed local caching units associated with local access nodes giving 
remote clients access to said wide area networic, said cacheable material stored at said 
local caching units being given a distinctive identifier, and intercepting requests from 
clients at said local access nodes for material with a said distinctive identifier and first 
routing said requests to the local caching unit for retrieval of the material therefrom. 

To ensure that the cached items can be retrieved as quickly as possible* the cache 
is desirably located at an ISP's point-of-presence. 

The invention will now be described in mm detail, by way of example only, with 
refer ence to the accompanying drawings, in which:- 

Figure 1 is a block diagram of a system for disseminating information over a wide 
area network in accordance with the invention; 

Figure 2 is a diagram similar to Figure 1 showing information flow; 

Figure 3 is a data flow diagram. 

The system for disseminating information over a wide area network, typically the 
Internet, is illustrated in Figures 1 and 2. The system comprises a central cache complex 
or web hosting system 1 consisting of servers 2 and mass storage devices 3 located near a 
satellite up-link station 4, which provides a cache update channel 3 via a satellite 
transponder 6 to a receive only receiver 7. The update channel 5 uses commercially 
available transport software located at the web hosting site 1 and the ISP sites 8. The 
content is encrypted before transmission. 

The receiver is connected to a subscribing ISP (Internet Service Provider) 8 
connected to the Internet 9, which provides a return path to the central cache 1 . The ISP 
includes a local caching complex 10, consisting of servers, and mass storage devices 1 1 
for storing cacheable web pages as well as custom filtering software, a web site, and a set 
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of authoring tools and utilities, to be used by content providers for altering and uploading 
their material 

The main function of the central cache or web hosting system 1 is to store cached 
pages and handle requests for cached pages that cannot be served by the ISP's local cache. 

The ISP caching complex 10 is located near an ISP's point of presence. Its main 
function is to efficiently store and manage cached material. Software, to enable ISP 
providers, based on their resource availability or other considerations, to choose the 
content to be cached, is also commercially available. 

A content provider 1 2, having servers 1 3 associated with mass storage devices 
1 4a, 1 4b is connected to the Internet 9 and hence to the central cache complex 1 . The 
storage devices 14a store cacheable material and the storage devices 14b uncacheable 
material. Cacheable material is generally material of a more permanent nature, rich in 
graphic content, whereas uncacheable material is generally more transient material, 
preferably comprising smaller files. Uncacheable material might include information 
which is continually changing such as stock market quotes, whereas cacheable material 
might include more static but frequently accessed content such as home pages. 

The web site, authoring tools and utilities are used to assist content providers 12 in 
^referencing their web pages into cached and uncached elements, uploading these 
cacheable pages for storage and broadcast, and for performing registration and 
membership functions. 

The centra] caching complex 1 can be associated with one or a contiguous subset 
of IP addresses* 

A content provider 12, wishing to cache his material with the central complex 1, 
first registers with the central complex 1 at its web site. Once registered, the content 
provider will be given access to a set of tools and utilities to enable him to maintain his 
cached material The Content Provider will be billed monthly for use based on a 
published tariff E-cash and credit card mechanisms are the preferred payment methods. 
An automated system e-mail receipts and keeps die subscriber informed. 
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An ISP wishing to become a franchised member will need to contact the 
marketing group of the facility maintaining the central caching complex. 

Once registered, the content provider must determine what files are to be cached. 
The tools provided will allow both global changes to URLs (e.g frequently accessed gif 
files) and a step-through URL by URL approach. Typically, large inline images, java 
applets, video and audio clips will be cached. 

The URLs (Universal Resource Locators) associated with cacheable items will 
have the monicker mdc.net inserted after the http:// string. For example, a link having the 
URL http://www.cpl .com/bigpicture.gif will become 
http://mdc.net/www.cp1 .com/bigpicturcgif. 

The URL's of non cacheable material e.&, the borne page frame, cgi files, e- 
commerce or personal forms as well as private key material are not changed. 

As in present caching systems, there exists no mechanism to stop mischievous 
cachers from pointing to a cached item, such as a video clip, and there exists no 
mechanism for the couent provider to be aware that the cached item has been accessed. 
Material requiring access control thus must be left uncached or be so encrypted that a 
private key, available only at the home site, is required for decryption. 

As web content is often customized per customer on the go, the customization 
software will need to be aware of material previously cached. For this purpose, a library 
of cached items will be maintained for the user. 

The content provider can upload the material to central complex 1 for broadcast by 
executing the up'oad function available at the central web site. The upload function win 
perform a simple FTP (File Transfer Protocol) of the files so designated by the content 
provider. These files will be stored at central complex 1 and a daemon associated with the 
uplink 5, alerted that files have been sent, will broadcast them to the ISPs via the satellite 
transponder 6. 

The content provider will be given several choices for ISP distribution. A map 
will be provided of subscriber ISPs. Based on a page's community of interest, the content 
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provider might elect to distribute the material in selected regions. A web page, for 
example, advertising Caribbean holidays might be distributed only to North American 
urban centres. 

At the web site of the central complex 1. a daemon 15 will monitor which files axe 
being uploaded. The upload feature is enabled only for subscribers. MFTP. for example. 
(Multi-cast FTP from Starburst Corp.) can be used as the protocol for ensuring accurate 
and sYDchnmized delivery to all the member ISPs. If all ISPs are not updated the process 
backs out and an alert is sent to a netwoik manager at the central complex l.Thc manager 
determines the cause and tries again. The network manager also keeps track of which 
subscribers have received what material 

Software is provided at the ISP site 8 to enable the ISP to save or discard 
Incoming material. This is done after reception. If the material is an updated version, 
deletion if it will also delete the original cached item. 

The content provider's web site 12 is partitioned and cached. If a client 1 6 
connected to ISP provider 8 wishes to access this site three routing scenarios are possible. 

(1) requests for uncached material 

(2) requests for cached material that is present at the ISP and 

(3) requests for cached material that isn't present 

fa normal operation a client 16 attached to ISP 8 wishrog to access a content 
provider 12 types a URL on bis or her web browser, such as http:Ztowwxp.coin. The 
router 17 receives the request from the cbent 16 and obtains the IP address from the 
Domain name server serving the ISP 8. Once the IP address has been obtained , a TCP 
connection is established from the client 16 to the content provider 12 over the Internet 9. 
When using the system in accordance with the invention the client 16 will normally 
request access to an uncacheable page and be granted access to it at the content provider's 
site 12 in the conventional manner. 
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If the client 16 requests a link to a cached page, recognizable by its unique 
monicker, the router recognizes the request and routes its to the local cache 1 1 to retrieve 
the appropriate material and pass it to the client 11. To effect the redirection of flo 
the local cache instead of the content provider's site, changes only need to be made to the 
ISP's router's tables using a static route. In this implementation, mdc.net is assigned two 
IP addresses, one for all its local caches, another for its central cache. In static routing, all 
addressing that is prefixed by the local cache IP address is routed to the local cache 
server. 

In the example shown in Figure 3 mdc.net is assigned the address 1 66.24.56.254 
and mdc2.net is assigned the address 166.24.64.254. 166.24.56.254 is assigned the static 
route - aO packets are forwarded to Ethernet port 1/4 in the ISP 8 and subsequently to the 
local cache server. 

The possible message flows and flow diagrams are depicted in Figures 1,2 and 3. 
Scenario 1 

The client 16 requests a connection to http:Wwww.cp3.comMiomepage.html. 

The client's browser via the DNS (Domain Name Server) 20 and, using UTP, 
resolves and returns the IP address ofwww.cp3.com. Once returned, a TCP connection is 
set up in the usual way through the Interact 9 and all IP packets axe routed, by the ISP 
router 1 7 t in a standard fashion to the client 16 from die content provider 1 2. 

Scenario 2 

By clicking ooatink embedded in a previously delivered page, the client requests 
a connection to: http:\\mdcj*t\ww^ 

The client's browser via the DNS 20 associated with the ISP 8 and, using UTP, 
resolves and returns the IP address cf mdcaet, which corresponds to the IP address of the 
central caching complex 1. Normally the browser would then set up a TCP connection, 
via the ISP's router to central cache site. However, the router 17 first looks at its static 
routing table and sees thai all references to the IP address corresponding to mdc.net are to 



be *on circuilcd to the local cache. A TCP co^fa, between 0* C , 1CM 16 ^ 
storage devices 1 1 if present. 



Scenario 3 



The client requests a connection to: httpA^etW ^.com^igpicturc.gif 
The browser via DNS 1 7 and, using UTP, resolves and returns the IP address of 

•ccsthat aD references to the IP address ofnsdc.net are to be short circuited to the local 
«che 10 . A TCP connection between the client ^ the loc^ cache is then set-up but the 
file w^.cpj.comNbigpicture.gif is not found The local cache then re-ini.tiates the 
request ^^^^^^^^^^^ ^ 

»F^fh*to the router 17 Utenon toma^net. the location of central cache 1. In the 
c^ofaWennxhvofc^^^ 

through message forwarding at the central cache 1. 

The system in «cordance with the invention thus provides a web hosting service. 
enabUng efficrent storage of content provider selected cacheable and non cacbcable web 
content, and software for changing existing web content I, also provides a reliable cache 
"Pdate system including a broadcast channel and uploading facility, an Internet 
a^gententchannel.^^ 

^ C ° mPnSmfl ^ "-ers, fi'tcring software to select cacheable material, the 
use of state routes to redirect request and sofW to effect mese changes in U* ISP 
routing tobies in order to redirect request U> the ISP cache or toflte web host 

Other aspects of the invention include differentia] referencing of the web content, 
and process caching « the subnet router, both important elements of a seamless and 
ample inter- working of die system. 
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^ M^ict* U no impact on (he routing P~e o,^ * 

coiMcplkand saveis - an important improvement over easting models. 

^^..oC^a^o^rsovOto Uo. ^suooc. SpooGnsdescn^. 

sU^oninwhi*.-."^^"*^* 0 ^^^ 

^..•^Mo.acooor-u.^^.^C^.^^.o 

e^m/Uv for subnets without a motor server, 
achieve, another important inmrovcmenL Secondly, lor suoncis 

acnicvc, «uxvu~ mxic „ r TIM is used means that clients will still 

the fact that a globally resolvable address (DNS or IP) « usee means 

able to resolve th* address to an actual server. This scheme prtmdes an elegant 

^ unchanged- a very important irnprovement over cxistmg schemes. 
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THE EMBODIMENTS OF THE INVENTION IN WHICH AN EXCLUSIVE PROPERTY OR 
PRIVILEGE IS CLAIMED ARE DEFINED AS FOLLOWS: 

1 . A system for disseminating information over a wide area network, comprising: 

a) a central caching unit for storing data to be made available over said wide area 
network; 

b) a plurality of local access nodes for permitting users to access said wide area 
network; 

c) distributed caching units associated with said local access nodes for storing 
cacheable material; 

d) a communications system for establishing communications between said central 
caching unit and said local caching units for the transfer of cacheable material from said 
centra] caching unit to said local units; and 

d) routing means at said local sccess nodes for routing packets from users to a 
destination address* said routing means including local routing tables containing the 
addresses of material cached at the associated local node and responding to routing 
requests for cached material by first directing said requests to the local cache. 

2. A system as claimed in claim I, wherein said communications system is a 
multicast communications system. 

3. A system as claimed in claim 2, wherein said multicast communications system is 
a satellite communications system. 

4. A system as claimed in claim 2, wherein locally cached material has a distinctive 
ide ntifi er, and said local routing tables respond to a request for material with a said 
distinctive identifier by associating it with the network address of the locally cached 
material 

5. A system as claimed in claim 4, wherein said distinctive identifier is also 
associated with the address on said wide area network of said central caching unit, and in 
the event said material is not available in the local cache, said local cache is programmed 
to substitute the address on said wide area network of said central caching unit and set up 
a connection via said router with said central caching unit over the wide area network. 
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6. A system as claimed in claim 5. wherein said distributed caching units comprise 
servers and storage devices on a local subnet attached to said routing weans. 

7. A system as claimed in claim 2, wherein said local routing tables are static routing 
tables. 

8. A system as claimed in claim 2 further cornprisinu at least one content provider 
connected to said wide area network, a storage device at said content provider storing 
uncacheable material for access by a client over said wide area network. 

9. A system as claimed in claim 8. further comprising means responsive to 
commands torn said content provider to distinguish cacheable material from non- 
cacheable material 

10. A system as claimed in claim 9. further comprising means for uploading cacheable 
material over said wide area network from said content provider to said central caching 
unit where it can be made available to said clients either over said wide area network or 
from said distributed caching units associated with said local nodes. 

11. A system as claimed in claim 10 furthCT comprising filtering means at said 
distributed caching units to permit multicast material to be filtered in accordance with 
local requirements. 

12. A system as claimed in any one of claims I toll, wherein said wide area network 
is the Internet 

13. A method of dissenimatrng information over a wide area network, comprising the 
steps of: 

a) storing cacheable material to be made available over said wide area network at a 

central cacjing unit; 

h) disseminating said cacheable material over a communications system to 
distributed local caching units associated with local access nodes giving remote clients 
access to said wide area network; said cacheable material stored at said local caching 
units being given a distinctive identifier, and 

c) intercepting requests from clients at said local access nodes for material with a 
said distinctive identifier and first routing said requests to the local caching unit for 
retrieval of the material thejefrnm. 
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14. A method as claimed in claim 13. wherein said material is disseminated using 
multicast techniques. 

15. A method as claimed in claim 14* wherein said requests are then routed from the 
local access node to said central caching unit or the corresponding content provider via 
said wide area network in the c. ent that requested material is not available in the local 
caching unit 

16. A method as claimed in claim 14, wherein the addresses of said local caching 
units are stored m local routing tables in a router associated with a local access node. 

17. A method as claimed in claim Id, wherein said local routing tables are static 
routing tables. 

18. A method as claimed in claim 18, wherein said cacheable material is multicast via 
a satellite com mu nications system nf*»K«*»«g satellite communications between said 
central caching unit and said local caching units . 

19. A method as claimed in claim 18, wherein cacheable material is uploaded to said 
central caching unit for multicasting to said distributed caching units via said wide area 
network. 

20. A method as claimed in claim 1 9, wherein uncacheable material is stored at a 
contest provider's site and made available to clients via the wide area network. 

21. A method as claimed in claim 14, wherein material received at said distributed 
f » r fr jn g units is filtered in a ccor d ance with local requirements. 

22. A method as claimed in claim 1 4, wherein said wide area network is the Internet 
aad said distinctive identifier b a URL with a distinctive monicker embedded in the URL. 

23. A method as claimed in claim 12, wherein said distinctive monicker is the domain 
name of said central c a chin g ami 

24. A method as claimed in claim 20, wherein the content provider selects and 
identifies cacheable and uncachablc material 
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